Computer Science - Software Engineering
Subcategories
Papers
HiRoPE: Length Extrapolation for Code Models Using Hierarchical Position
Addressing the limitation of context length in large language models for code-related tasks is the primary focus of this paper. Existing LLMs are constrained by their pre-trained context lengths, lead...